A Double-Penalized Estimator to Combat Separation and Multicollinearity in Logistic Regression

نویسندگان

چکیده

When developing prediction models for small or sparse binary data with many highly correlated covariates, logistic regression often encounters separation multicollinearity problems, resulting serious bias and even the nonexistence of standard maximum likelihood estimates. The combination makes task more difficult, a few studies addressed simultaneously. In this paper, we propose double-penalized method called lFRE to combat in regression. combines logF-type penalty ridge penalty. results indicate that compared other methods, can not only effectively remove from predicted probabilities but also provide minimum mean squared error. Aside that, real dataset is employed test performance algorithm several existing methods. result shows has strong competitiveness them be used as an alternative solve problems.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Solution to Separation and Multicollinearity in Multiple Logistic Regression.

In dementia screening tests, item selection for shortening an existing screening test can be achieved using multiple logistic regression. However, maximum likelihood estimates for such logistic regression models often experience serious bias or even non-existence because of separation and multicollinearity problems resulting from a large number of highly correlated items. Firth (1993, Biometrik...

متن کامل

Asymptotic properties of a double penalized maximum likelihood estimator in logistic regression

Maximum likelihood estimates in logistic regression may encounter serious bias or even non-existence with many covariates or with highly correlated covariates. In this paper, we show that a double penalized maximum likelihood estimator is asymptotically consistent in large samples. r 2007 Elsevier B.V. All rights reserved.

متن کامل

Weighted Ridge MM-Estimator in Robust Ridge Regression with Multicollinearity

This study is about the development of a robust ridge regression estimator. It is based on weighted ridge MM-estimator (WRMM) and is believed to have potentials in remedying the problems of multicollinearity. The proposed method has been compared with several existing estimators, namely ordinary least squares (OLS), robust regression based on MM estimator, ridge regression (RIDGE), weighted rid...

متن کامل

Penalized Logistic Regression in Case-Control Studies

Likelihood-based inference of odds ratios in logistic regression models is problematic for small samples. For example, maximum-likelihood estimators may be seriously biased or even non-existent due to separation. Firth proposed a penalized likelihood approach which avoids these problems. However, his approach is based on a prospective sampling design and its application to case-control data has...

متن کامل

A penalized logistic regression approach to detection based phone classification

Recently, we have proposed a detection-based speech recognizer which has two main components: a bank of phonetic feature detectors implemented with hidden Markov models (HMMs), and an event merger. Each detector generates a score that pertains to some phonetic features, e.g. voicing. The merger combines all these scores to generate phone labels. The parameters of the detectors and the merger ca...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Mathematics

سال: 2022

ISSN: ['2227-7390']

DOI: https://doi.org/10.3390/math10203824